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ABSTRACT 


In  this  paper  we  demonstrate  that  It  Is  possible  to  extend  Frlcdlsnd's 
(Ref.  1)  bias  estimation  technique*  as  recently  rederlved  In  a constructive  manner 
by  Mendel  and  Washburn  (Ref.  8)»  to  the  problem  of  estimating  dynamical  states  and 
colored  noise  states.  We  have  shown  how  to  obtain  an  exact  multistage  decomposi- 
tion not  only  for  the  state  estimation  equations*  but  also  for  the  associated 
error  covariance  equations.  Additionally*  we  have  obtained  a second-order  sub- 
optlmal  multistage  estimator,  using  a perturbation  technique.  Whereas  a hlgh^order 
■atrlz  Rlccatl  equation  mnet.  be  solved  tdien  the  exsact  results  are  used,  a matrix 
llccad  equation*  of  the  dimension  of  the  colored  noise  states,  must  be  solved  when 
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In  thin  paper,  wa  extend  Frledland’s  (Ref.  1)  bias  estimation  technlqua,  as 
recently  rederlved  In  a constmctlve  manner  by  Mendel  and  Washburn  (Ref.  8),  to  the 
Important  problem  of  estimating  dynamical*  states,  x(t),  and  colored  noise  states, 
£Ct) , for  the  following  system: 


e 

X 

• Ax  +■  Ba,  +■  u 

; xCO) 

(1) 

• ca  +■  ew 

; *,(0)  ; 0 i e <.  1 

(2) 

iCt) 

• to  + V 

(3) 

We  do  not  show  the  explicit  dependence  of  vector  and/or  matrix  quantities  on  time, 
for  notatlonal  slmpUclty.^  In  5,  xeR®^  AeR®^,  CcR^^,  u«r“,  ^R*”,  w»R*^,  BaR®’*’^, 
y«R*,  RaR*^ , vaR*  i xCO)  sad  ^(0)  are  Independent  gausslsn  random  vairlables;  and» 
u,  w^  and.  ▼ are  gaosslan  white  noise  processes,  for  which 


Ka)  • l{jr}  » ^ snd  E{v}  • 0 (4) 

l{a(t)u*(T)>  - QidCt  - t)  (5) 

l{nr(t)w'(T)e}  • e^gdCt  - t)  (6) 

l{a(t)a'(T))  - 0 (7) 

(T)  ) - Ri  (t  - t)  (8) 

i 


and** 

Colored  oolae  oceeas»  axe  described  by  a flrst->order  Markov  process  which  la 

not  affected  by  the  dynamical  ^-states.  Scalar  parameter  c,  idilch  ranges  between 


^ 

i 

* Strictly  speaklns,  JiXO  *Bd  j,Ct)  are  both  dynamical  state  vectors;  however,  { 

since  it  haa  become  cnatomary  to  refer  to  x,Ct)  as  colored  noise,  we  shall  | 

distinguish  between  jCt)  and  j^(t)  as  Indicated. 

**a  A ^ -0.  j 


I 


J 


I, 
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dynaalcal  aystan*  whara  z and  ^ atata  aquatloaa  ara  conplataly  couplad,  la  glvan 

« 

In  Waqhburn  (Baf.  4}  and  will  ba  raportad  on  In  a latar  publication. 

Our  oultlataga  fUtaxlng  raaulta,  for  colorad  nolaa  and  dynamical  atataa,  are 
given  In  Section  II..  Thaaa  raaulCa  ara  alao  compared  with  the  laaa  ganaral  reaulca 
of  Tadcar  and  Laa*and  Frledland.  Sub^tlmal  aacond-ordar  filtering  algorltbrna, 
obtained  via  a partnrbatlon  tachnlquai  ara  daacrlbad  In  Section  III.  Proof  a for 
all  thaorama  ara  given  in  the  appandlcaa . 


II.  EXACT  MPLTISTACT  PILTERING  HZSULTS 

Our  main  raaolta  ara  acatad  in  the  following: 

Thaoram  1.  7or  ayatam  S.  If  P CO)  * 0»  than  the  oultlataga  olnlaun-varlanca 

xz 

filter  aatiaator>aquatl<nis  ara: 

1 - i-'-Ti  + i 

i - ci  ^ ^ ; ICO) 

i - C4  - K^H)i  + K^IlCt)  - ^ • H7i  - ^ 


iCO) 


and 


z • CA  - ^ » 2.C0) 


whara  the  galna  ara 

▼ - CA.  - «^jH)7  1 - VC  ; VCO) 

\ • ail  F^v»)H'ir»^ 

- (Fx  Fx2V»)H»iri 


E - P^  E'E*! 

»1  *1 

Error  covarlanea  natrlz  T,  where 

f • 


C12) 

CIS) 

C14) 

CIS) 

CIS) 

C17) 

CIS) 

(19) 


Fl 

Fia 

.Fll 

. 

C20) 


Tha  proof  of  this  theoren*  which  Is  patterned  after  the  constructive 
derivation  of  Frledland's results  given  by  Mendel  and  Washburn  (Ref.  8),  Is  sketched  ^ 
In  Appendix  A. 

Cosanents  t (1)  Equations  (IS) , C19) > and  C26)  comprise  a filtering  system  for  the 
estimation  of  x <S  when  colored  noise  states > Zj,  do  not  exist.  As  such,  with 
states  present,  x Is  not  optimal  In  any  sense,  since  the  true  measurement,  xCt)>  which 
contains  effects  due  to  Is  used  to  obtain  x. 

A 

(2)  Signal  £ Is  an  estimate  of  an  nxl  residual  noise  process,  £,  which 
satisfies  the  following  state  equation  (see  Appendix  A for  derivation) : 

£ - (A  - K^^H)£  - ? £(0)  - 0 (27) 

Observe  that  for  c » 0.  the  unique  solution  for  £ Is 

£(t)  - £ ? t > 0 (28) 

• 

This  resole  Is  motivation,  for  a suboptlmal  series  expansion  of  the  Theorei  1 
equations  about  r • 0,  the  details  of  which  are  given  In  Section  III. 

(3)  Observe,  in  Eqs.^  (17)  and  (18),  that  K,  and  K.  depend  on  elements 
Px  and  Px2  of  error  covariance  matrix  P.  It  can  be  shown  Chet 


where  zx  la  asaoclated  with.  Che  artificial  svstsm^  ix  * ^ 2^(t)  * 

la  iriilch  artificial  measorement  Z^Ct)  1>  nonazlscent  since  It  Is  predi*^ 
eated  on  the  artificial  asanapclon  that  the  measurement  la  not  affected  by  £. 


This  notion  Is 


useful  for  analysis  purposes.  Wis  wish  to  emphasise  the 


fact  Chet  £ and  ^ era  quite  different;  for  during  the  development  of  2 we  use 
XCt)  which  Is  affected  by  £,  whereas  la  the  devalopmant  of  sx»  '***  Z^Ct)  which 
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• is  uxiaff«ct«d  by  Th«  two  estimates  are  related  however. 

(4)  Matrix  P is  of  dimension  (n+r)  x (n+r);hence,  we  have  been  led  to 
the  computation  of  a large-scale  matrix  Riccatl  equation,  (21),  just  as  we  would 
have  been  had  we  followed  the  usual  procedure  for  obtaining  ^ and  z by  applying  the 
Kalman  filter  equations  to  Equations  (1)  and  (2) . This  obviously  represents  a 
serious  limitation  of  our  general  results,  and  points  out  a shortcoming  of  this 
multistage  decomposition  approach  fqr  colored  noise  states.  In  Section  III,  we 
obtain  a subop tlmal  filter  that  does  not  require  the  computation  of  a large-scale 

P matrix. 

(5)  For  e « 0,  we  have  the  case  considered  by  lacker  and  Lee  (Ref.  2). 
It  Is  straightforward  to  show  that,  for  e - 0 

Pi  - 0 (31) 

and 

Pl2  • 0 ^ t >0  (32) 

This  Is  a direct  consequence  of  Eqs.  (28),  (29),  and  (30).  In  th*s  ease,  we 
obtain: 

Corollary  1.  For  e • 0,  the  Theorem  1 results  reduce  to: 

X • i yi.  (33) 

and 

i - Cx-KK  ^(t)  -HVz ; x(0)  (34) 

where  the  gains  are 

V - (A  - B - VC  ; V(0)  - 0 (35) 

and 

1^  • P^(H7)’R“1  (36) 

The  error  covariance  matrix  is  computed  from 


-7- 


■ CP^  *►  P,C'  - P^CH7)’R"1CH7)P^  ; P^(0) 


P - P + VP  V 
X zi  z 


iriiara  P^^  still  satisfies  Eq.  (26). 


It  is  of  Interest  to  conpere  our  results,  in  Eqs.  (33)  - (39),  with  those  la 
^*®^**J^  •od  Lee  (Ref.  2).  Their  results  are  United  to  a constant  C iiiatrlx{  our  C 
■•trlx  can  be  tine*^ar7lng.  They  also  require  some  extra  calculations,  which  we 
do  not»  Their  gain  matrix  V^  (Bq.  (12)  in  Ref  ► 2]  must  be  computed  and  inverted  to 
obtain  a gain  matrix  comparable  to  our  matrix  Y-  They  also  compute  a matrix  M 
[Eq.  (13)  in  Ref.  2]  which  has  no  physical  meaning,  and  from  which  they  compute 
^xz*^  ^ caaq>lete  comparlaon  between  these  results  is  found  in  Washburn 
(Ref.  4). 

(6)  For  r • 0 and  C »■  0,  we  obtain  the  situation  considered  by 
Frledland  (Ref.  1)  and  Mendel  and  Washburn  CRef . 8) . In  that  ease,  we  obtain: 

Corollary  2.  For  e ■ 0 and  C • 0,  the  Theorem  1 results  reduce  to: 

i - f40) 


* • i ^(0) 


where 


(A  - KjjH)y  + B 


# - -P_(HV)'R-l(HV)P^  ; P,(0) 

mm  mm 


The  equations  for  K^,  P^,  and  P^  are  those  given  la  Corollary  1. 


— 8— 


Tbas*  results  are  Identical  to  those  obtained  by  Frledland  and  Mendel  and 
Washburn. 


III.  A SOT-OPTIMAL  SECOMD-ORDER  MDLTISTAGE  ESTIMATOR 

As  discussed  In  Section  II,  the  exact  multistage  filtering  results  for  adding 
colored  noise  states  Includes  the  calculation  of  (nfr)  x (nrH;)  matrix  P,  uhere 
ttfr  • dimQc,^.  In  this  section  we  develop  a sub-optimal  multistage  estimator 
by  means  of  a perturbation  technique  which  can  be  found  In  numerous  references 
(Jlefs.  S,  6,  and  7 for  example). 

To  begln»  we  review  the  essence  of  the  perturbation  technique.  Given  the 
differential  equation 

A(t,e)  - fa,e,t)  t A(0)  (44) 

where  t e [0,T]  and  0 ^ e <1»  and,  f Is  analytic  in  (A,e*t);  then,  for 
sufficiently  snail  e.  die  following  McClaurln  series  converges  to  A: 


A - 


I ^ 


(45) 


where 


(n) 


(46) 


de  ' t • 0 


which  can  be  computed  using  the  following  system  of  equdtlons. 


Ka)  . f (A,c,t) 

® dc“ 


e • 0 


, tt  ^ 0,1,Z,».< 


(47) 


It  la  difficult  to  quantify  what  la  meant  by  "sufficiently  small  c,"  since 
the  bounds  needed  for  c to  be  small  are  functions  of  the  A^^^  n • 0,1,2,...,  and 
these  quantities  are  very  difficult  to  compute  a priori.  An  example  which 
lUastrates  the  range  over  which  the  preceding  appraximatlon  is  valid  la  given  at 
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the  end  of  this  section. 

Applying  this  perturbation  technique  to  our  results  In  Theorem  1,  one  obtains 
the  following  results,  which  are  proven  in  Appendix  B. 


Theorem  2.  For  system  S,  if  P^^(0)  ■ 0 and  e Is  sufficiently  small,  then  sub- 
optlaal  nultlstage  mlnlauot-’varlance  filter  estimator  equations  are  given  by 
Eqs.  (12)  - (19),  where  now 

Pi  • (48) 

Pl2  - e^Pfi  (49) 

and 

Pg  • Pj  + (50) 

In  Eqs.  (48)  — (50),  P|,  Pf  computed  from  the  following: 

P2  • (A  - K H)Pf  + P2(A  - K H) ' + VQ,7'  , Pf  (0)  - 0 (51) 

+ '?2<='  - fh*2%  - - '">2.  ■ “ «« 

'r  ■ + V'  - Wz  • 'z«>  <“> 

and 


'I  • «=- + W' -'uSa^ 

where 

Aj  - 

A,.  - a'R'^HF 
12 

and 


(54) 


(55) 

(56) 


(HF) 


(57) 
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Figure  1 depicts  the  order  of  computetlons  for  these  equations.  Observe,  that 
we  no  longer  aust  solve  an  Cn+r)  x (n+r)  Riccati  equation.  Equations  C51) , (52), 
and  (54)  are  Lyapunov-type  equations,  whereas  Eq.  (53)  is  a Riccati  equation,  but 
it  is  only  an  rxr  equation.  At  each  stage,  the  quantities  shown  in  the  boxes,  in 
Figure  1,  can  be  computed  for  all  t e [0,T]  using  quantities  at  earlier  stages. 

We  refer  to  our  suboptiaal  estimator  as  a second-order  3uboptj"»«1  multistage 
because  we  have  e:q>anded  P^,  and  P^  in  a three-teim  expansion,  like 

Eq.  (45);  and,  a three-term  expansion  includes  terms.  Observe  that  for  the 
colored  noise  case,  as  we  have  defined  it,  we  must  go  out  to  at  least  a second- 
order  approximation.  There  are  no  e-terms  in  expansion.  This  result  is  a 
peculiarity  of  our  particular  problem,  Washburn  has  considered  the  application  of 
this  perturbation  technique  to  weakly  coupled  systems,  and,  in  that  application 
first-order  ea^anslons  are  possible  (Ref.  4).  Observe  also  that  we  have  a sub- 
optimal  multistage  estimator  rather  than  a suboptimal  estimator  because  our 
starting  point  was  Theorem  1 instead  of  an  augmented  Kalman-Bucy  filter. 


Kxanple . Here  we  present  a numerical  example  .which  demonstrates  the  accuracy  of 
our  second-order  suboptimal  multistage  estimator.  Our  system  is: 


e 

X 

z 

7 


-X  + 2 + tt 
-2  + etr 
X +■  V 


x(0) 


(58) 

(59) 

(60) 


where  all  signals  are  scalar*,  and,  qj^  " ^2  * * 1/3. 

In  order  to  evaluate  the  performance  of  our  suboptimal  estimator,  we  computed 
the  exact  steady-state  error  covariances  for  S and  have  compared  these  values  with 
their  Theorem  2 counterparts.  The  exact  steady-state  error  covariances  were 
obtained  by  solving  the  nonlinear  coupled  algebraic  Riccati  equations  for  S using 
an  extended  Newton-Raphson  iteration  technique.  Wa  obtained  the  following  steady- 


U 


I 


-u- 


state  valuas  for  P , P and  P , fron  Eqs.  C48) 
X xz  z 


(54): 


X 3 ^ 12  ® 


P • i 
xz  6 


-i  ^2 


Quantities  P^,  P^,  and  P^  are  depicted  In  Pigs*  Z,  3,  and  4.  Both  the  approxdaate 
(solid  curves)  and  exact  (dashed  curves)  results  are  given  as  functions  of  c. 
Observe  that  the  second-order  results  appear  to  be  quite  good  for  e as  large  as  1/2. 
Our  suboptliaal  multistage  filter  equations  are: 

X - x^z^t  (62) 


i - . ico) 

? - , 1(0) 


Of  course^'  x muse  be  computed,  for  the  first-order  Ka Imati— Buep  filter  equations 
(15),  a9),  and  (26). 

17.  COMCLUSIONS 

Vz  have  demonstrated  thah  le  Is  indeed  possible  to  coctend  Frledland's  (Eaf.  1) 
estimation  technique  to  the  problem  of  estimating  dynamical  states  and  colored 
noise  states.  We  havm  shown  how  to  obtain  a multistage  deco^)oeltlon  not  only  for 
the  state  estimation  equations,,  but  also  for  the  assoclsfed  error  covariance 
equations.  Additionally,  we  have  related  our  results  to  Frledland's  and  Tacker 
and  Lee's  (Ref.  2). 

lytr  exact  decomposition.  In  IhsoEim'  1,  can  be  viewed  from  a number  of  points 


of  view.  As  a 


It  shows  us  bow  estimates  of  a lower-order 


systM  (l.e. , jD  most  be  modified  whan  colored-noise  states  are  added  to  the 
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'^Ascrlptioii  of  that  sysCoB^  Kb  sucht  this  ksovlcdgc  be  used  to  Increase  our 
understanding  of  the  Interactions  bettieen  estimates  of  dynamical  and  colored  noise 
states.  It  also  suggests  possibilities  for  further  approximations t vfalch  can  be 
used  to  reduce  the  complexity  of  the  exact  results.  As  a computational  result . It 
shows  us  that  there  does  not  seas  to  be  any  way  to  avoid  having  to  solve  a larger 
matrix  Rlccatl  equation.  As  such*  the  exact  decomposition  Is  disappointing;  but* 
we  have  also  shown  how  to  reduce  camputatlons  (at  least  with  respect  to  having  to 
solve  the  larger  matrix  Sicca tl  equation)  by  means  of  a perturbation  technique. 

One  can  also  view  onr  Tbaores  1 results  in  the  context  of  decentralized 
estimation  theory.  Signal  i la  estimated  at  one  level,  then  ^ and  ^ are  estimated 
at  the  second  level,  after  which  coordination  takas  place  at  a third  level  to 
provide  us  with  x»  Sandell,  et  al.  (Ref.  9),  mention  that  In  decentralized 
control,  idien  the  coordinator  has  access  to  full  knowledge  (l.e.,  at  each 
instant  of  time,  each,  local  subsystm  transmits  Instantly  and  without  enror  Its 
measurements  and  controls  to  the  coordinator,  and  the  coordinator  has  perfect 
recall)  his  optimal  strategy  Is  to  cancel  the  locally  computed  controls  and 
substltnte  the  global  optimal  controls.  Perhaps  this  same  phenomenon  Is  happening 
In  onr  Theorem  1 results.  This  would  explain  the  need  for  ^ and  the  resulting 


Oar  proof  of  Thoorcm  1 Is  psttemsd  sftsr  tbs  coastractlvs  dsrtvstlon  of 
Frlsdland's  results,  given  in  Ref.  8,  end  la  Ueshbum's  dlssertstlon  (Bnf.  4). 

Due  to  page  lialtstions,  we  give  only  s brief  sketch  of  the  proof,  since  the  deteils 
ere  lengthy  and  can  be  found  in  Ref.  4. 

Oar  epproech  is  to  easuM  the  existence  of  the  decoaposltion  f or  t la  Eq.  (10), 


and,  to  assuae  that 


1 • 8ii.  + B2I.  + B3X  4*  Bij^Ct)  ; 1(0) 


(A-1) 


i • Cil-K  C2I+ C3X  + Cijr(t)  i £(0) 


0^2) 


idxere  aetxlces  B^,  B3,  Bi^,.  Cir  Cz*  Ca,  and  C4  roaeln  to  be  detenined.  We 
than  require  thet  x,  li  and  1 be  unbiased  estiiaetes  of  at,  _r , and  respectively . 
Unbiesedness  detendnes  the  form  of  T,.  In  Eq*  (16),  and  it  coasermlns  Bi,  Bj,  and 
B3  to  be  specific  functions  of  B4.,  and  Cj,  C2,  oud  C3  to  be  specific  functions  of 
C4.  As  sudi,  the  requlreaenc  for  unbiased  estlaetes  reduces  the  raber  of  unknown 
Haaign  atatrlcee  In  Eqs*  (10),  (ini),  and  (An2)  fron  nine  to  two,  84  and  C4. . 

In  order  to  perforst  the  unbiasedness  enelysls  Just  described,  it  is  necessary 
to  obtain  the  following  Interesting  decoeiposltlon  of  state  vector  xi 

S * Aijsl  +■  hzL  ^ As  CA.“3) 

where  A^,  A2^  mA  A3-  setisfr  certain  linear  difforentiel  equetione  and  Zx  is 
associetad  with  the  artificial  avaten  (see  coment  3 after  TheoM*  1 for  farther 
die cuss Iona) . 

il  • tSl.  i » StW) 

2^  - %1-Kv  ^“5 


■ti  (see 


Bt  3 after  Thaorsi  1 for  farther 


(Ar4) 

(A-S) 


•14> 


Also  Modod  is  tbs  follovlag  rolstlooshlp  betwsen  nonooptlmsl  sstlaator  z 
optlasl  ostliBStor  of  zj, 

* - i + A2Z  + A3Z1  + A4 


(A-6) 


whsro  A2t  Xa*  and  A4  also  satisfy  certain  linear  differential  eqxiatlons,  which  are 
driven  by  Ai»  A2*  and  It  is  Inportant  to  understand  the  distinction  between 
z and  Estlaator  ^ Is  truly  optimal;  for,  It  Is  associated  with  the 
artificial  system  In  (A-4)  and  CA-5),  and  that  systan  knows  nothing  about  the 
colored  noise  states,  z*  Measurement  does  not  ezlst,  of  course,  since  the  real 
•yetem’a-measurammnt  is  affected  by  those  states  even  when  colored  noise  states 
are  suppressed  from  the  real  system's  state  aquation.  Estimate  z Is  obtained  for 
aystam  i • ^ 2.  *“  but,  jr  Is  affected  by 

By  means  of  Bqs . (A~3)  and  (A06) » It  is  then  possible  to  express  z z > z , 


• (si  - ii)  + (g,- 1) 

where,  interestingly  enough,* 


i • ib  • An 


V • Ag  - A2 


(A-7) 


CA-8) 


CA-9) 


Each  of  the  eatlmetas  la  (A*>7)  la  aa  optlsMl  estimate  tthls  would  not  be  the  caae 
for  IJ.  Equation  (A- 7)  la.  used  to  study  unblaaedaesa* 

To  detexnlae  gala  matrices  84.  and  C4,  the  trace  of  the  error  covariance  matrix 
for  2 A.  la  minimised,  using  gradient  matrix  calculations.  This  yields  Eqs. 

C17)  and  (18) . Using  these  optimal  valuas,  we  also  obtain  the  expressions  for  P 
and  P,  given  In  Eqs.  (21)  and  (24). 

Ks  have  assumed,  a priori,  that  our  estimators  are  linear.  Thus  far  we  have 


• Equation  (17)  can  be  obtalnfd  from  Iq.  (A-8)  and  the  differential  equations 
(Aaf.  4)  which  dafineAjand  A 4 • 


-15- 


not  ua«d  th«  fact  that  our  nolaa  procasaaa  ara  gausalan.  Ualng  this  liifoiaatlon« . 
It  follows  via  unlquanass  of  solution  of  the  aatrlz  Rlccatl  aquation  that  x and  it 
obtalnad  via  Thaoren  1,  ara  tha  optiaal  astlaators  of  z and  z. 

P 


I 
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Appeadlx  B»  Proof  of  Thtorem  2 


EquAClons  (48)  - (54)  are  obtained  by  applying  the  Eq.  (45)  perturbation 
technique  to  P In  Eq.  (21).  Our  counterpart,  to  Bq.  (47)  la: 


Pl2 

\ 

P“ 

* 

dc“ 

HjP  + PHj  - P(l|V)'H'R*l(l|V)P 


’ VQjV 

-VQj' 

» 

Q2 

/ 

(B-1) 


e • 0 


We  truncate  the  Infinite-series  expansions  for  P^,  ^12*  three  terns > 

l.e., 

P, 


% Pj  + ePj  -K  e2p2 


12 


(B-2a) 

(B-2b) 


and 


P,  P + ep‘  + e^p2 
z z z z 


In  order  to  obtain  Initial  conditions  for  Eq.  (B-l)>  we  are  led  to  the 
following  underdatezKlned  see  of  equatloner 

PjCO)  - Pj(0)  eP^CO)  «»•  e^PfO)  - 0 

PjiW)  " * c^PfjCO)  - 0 


C»-2c) 


P,C0)  - f^(0)  ♦ zP^CO)  ^ e^JCO)  - 0 


(1-3) 


* The  factor  of  ^ which  appears  in  the  third  tezai  of  ea^  eiqpansion  has  been 
abroKbed  into  the  aetrix  In  that  tezn. 


r 


1 

i 

j 

i 
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